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1. INTRODUCTION 

Optimization problems in the practical world are getting more and more complex and difficult. 
Artificial intelligence and soft computing algorithms has become one of the most popular means to solve 
increasingly high-dimensional global optimization problems [1]. Literature study shows rapid developments 
on evolutionary and population-based optimization algorithms over the past few decades. These algorithms 
have proven to be very useful in solving various types of mathematical and practical optimization problems 
[2-6]. Inspired by biological features, natural events, and scientific-related effects, many of these algorithms 
shows very promising performance in solving complex global optimization problems. Among others is the 
Gravitational Search Algorithm. 

Gravitational Search Algorithm (GSA) is a relatively new population-based global optimization 
algorithm [1]. In GSA, all the solutions are considered as agents, moving in the space in the feasible solution 
range. Inspired by the Newton’s law of gravity [7], the objective value of an agent correlate with its mass. 
Since a heavier mass yields a higher attraction force in the law of gravity, a better objective function in the 
GSA gives a relatively higher mass value to a particular agent. This, then, in turn, causes the agents in the 
search space to move towards agents with batter objective yields [8-9]. This mechanism allows the agents to 
learn from the search results and information of each other before the moving in a particular iteration. It is 
essentially a learning strategy in nature which grants GSA the ability to explore for a more diversified 
solutions. However, this fully-informed learning strategy can cause a poor trade-off between the exploration 
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and the exploitation abilities of the algorithm [7]. Over the past few decades, many different enhancements 
are proposed and tested for different population-based heuristic search mechanisms. Some of the examples 
can be found in [10-15]. Similarly, modifications and improvements on the GSA can also be found in the 
literature. Like many other population-based algorithm, one of the most commonly found modification is on 
the introduction of new operators into a conventional GSA. For example, a disruption operator was proposed 
to further explore the search space [16]. Other researchers attempted an opposition-based learning in the 
initialization stage of the search [17]. The Black Hole Theory was also introduced into the GSA in order to 
prevent premature convergence [18]. Beside all these, many other application-specific modifications on the 
GSA can also be found in the literature [19-24]. 

In this paper, an adaptive search step local search mechanism is introduced into the conventional 
GSA. The proposed modification is designed to enhance the exploitation ability of the GSA. It enables the 
algorithm to analyse the information around the neighbourhood of an agent, which in turn leads to solutions 
with relatively higher accuracies. This paper consists of four chapters. Chapter 2 discusses the mechanism of 
the conventional GSA and the proposed modification in details. The results from the conducted experiments 
are presented and analysed in Chapter 3. Chapter 4 offers a comprehensive conclusion drawn from the 
outcomes of this research. 


2. ADAPTIVE GRAVITATIONAL SEARCH ALGORITHM 

A conventional GSA essentially consists of several stages, including mass calculation, acceleration 
calculation, velocity calculation and agent displacements. Similar to most of the population-based 
optimization algorithms, the GSA begins with the initialization stage. In the initialization stage, a pre-fixed 
number of solutions are randomly selected from the feasible solution search-space. These solutions are 
known as agents in the GSA. Each agent is randomly assigned a feasible value from each dimension. Upon 
determining the yielded fitness function of each agent, the algorithm moves on to the looping stage, in which 
the algorithm will loop until a pre-determined termination criteria is met. 

The looping stage of a conventional GSA begins with the total gravitational force calculation. For 
each of the agents, X it=[xti, 1 , xti,2,..., xtij,..., xti,D ] , formula (1) is used to calculate the 
gravitational force from the K best agents [1]. 


poe MiMi t t 
Fij = Vek: rand,.G 5 - (a as x) (1) 
UKE 
in whichi=1,2,...,NPandj=1,2,..., D.t indicates the current generation; D denotes the 


dimension of the problem; rand; is a random step value between 0 to 1. M‘; and M'‘, denote the masses of 
agents i and k respectively; Rix represents the distance between agents i and k. KBest is the group of the top K 
best agents with best fitness yields, in which is defined in formula (2) [13]. 


K = NP (NP~1)x —— (2) 


G' in formula (1) denotes the gravitational coefficient. This coefficient can be calculated using 
formula (3) [25]. 





—) (3) 


t— ¢0 = 
G'=G x exp ( TX ae 
It is suggested in [13] to set G? = 100 and t = 20. tmax is the maximum generation number. The mass 
calculation for an agent can be calculated using (4) and (5) [25]. 


t 
Mt = = (4) 


= SNP t 
LK=1 Ik 


te = f(XD-f worst) (5) 

i f Xpest) —f (Xtworse) 

X' worst Tepresents the worst agent with the worst objective yield. X‘ges , on the other hand, is the best 

agent with the best fitness yield. Upon completing the total gravitational force calculations, the algorithm 
moves on to calculate the acceleration of each agent. This can be carried out using (6) [25]. 
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With the acceleration calculated, the velocity of each agent can now be determined, using (7) [25]. 
Finally, the agents are displaced and the algorithm loops on. 


t+1 — t t 

viz? = rand; X vj; + ai; (7) 
t+1 — t t+1 

Kip = Xi t Vij (8) 


In this research, a modification is proposed with the aim to enhance the GSA with a stronger 
exploitation ability. A local search mechanism with adaptive search step size is designed for the purpose of 
this modification. This search mechanism is designed to search the neighbourhood of a particular agent with 
a relatively larger search step. As the iterations go, the search step size is then automatically adjusted for a 
more detailed search. This adaptive search step feature enables the algorithm to perform a more scrutinized 
search without wasting too much time at the beginning of the search, which in turn grants solutions with 
higher accuracies, quicker. Figure 1 shows a better illustration of the decision making flow of the search 
mechanism, where A denotes the search step, D; refers to the solution value of an agent in a particular 
dimension at iteration i, while Ay and Ac indicate the new search step for the next iteration and the current 
search step, respectively. 
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Figure |. The proposed adaptive search step local search mechanism 


The proposed adaptive search step local search mechanism is then inserted into the looping stage of 
the GSA before the calculation of new total gravitational force begins, making it a new Adaptive 
Gravitational Search Algorithm (AGSA). Table | shows the inserted adaptive search step local search 
mechanism in the AGSA. 


Table 1. Algorithmic Steps of the Proposed AGSA 
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Adaptive Gravitational Search Algorithm 

t=0; 

FE,=0; 

Create a random initial population; 

while FEs < MAX _ FEs do 

for i= 1 to NP do 

Adaptive search step local search mechanism 

Obtain the total force that exerts on the i" solution according to (1); 
Calculate the acceleration of the i" solution according to (6); 
Compute the new velocity of the i solution according to (7); 
Obtain the new position of the i " solution according to (8); 
Evaluate of the i“ solution; 

if X t iis better than GBX then 

GBX =X ti; 

end if 

FEs = FEs +1; 

end for 

t=t+1; 

end while 








3. RESULTS AND ANALYSIS 

Experiments are carried out in order to investigate the performance of the proposed algorithm in 
solving optimization problems. The proposed AGSA is put to test to solve several well-established 
optimization test functions found in the literature. Table 2 shows the details of the test suites employed. 
The Rastrigin and Ackley test functions provide more rigorous tests on the global search ability of the 
algorithms as these functions come with a single global optima point with multiple local traps. All the test 
functions are minimization problems. 


Table 2. The Test Suite 





Function Formulation Range 
n poe 
Sphere peje y" 2 [-500,500] 
t=1 
Sh - _ 
Rasta fe (x) = y. (x? — 10cos(2mx;) + 10) [$37 
i=1 
Ackley = ee [-32, 32] 
fo (x) = —20.exp| -0.2 /— >» x? | +20 — exp (- >, cos(2nx;)) +e 
n i=1 n i=1 
n — 
Rosenbrock 2) = ) (100 (@? = xis)? + Gu 1) es 
t=1 
Booth f(x) = (x1, + 2x, — 7)? + (2x, +x, — 5)? [-32, 32] 





In order to benchmark the difference and improvement of the proposed AGSA, the results are 
compared to that of a conventional GSA. Genetic Algorithm (GA), a well-established optimization algorithm 
is also included in the benchmarking to further clarify the stand of the AGSA in terms of performance 
compared to other optimization algorithms from the literature. 

The tests are conducted using a 64-bit Intel Core-5 processor with 4 gigabytes or RAM. 
The algorithms are set to begin with 10 initial solutions. To avoid stochastic discrepancies, 10 independent 
runs are carried out for each of the algorithms in solving each of the test functions. The average values of the 
solutions returned are shown in Table 3. The best results in the comparison are highlighted in bold face. 

It can be observed from Table 3 that the AGSA has outperformed the conventional GSA in all the 
test functions in term of solutions accuracy as AGSA successfully returned with solutions with relatively 
lower average objective values. GA gave no competitive results, especially in test functions with multiple 
optima points, such as the Rastrigin and Ackley tests. Some convergence process are sampled from the 
experiments to examine the convergence performance of each of the algorithms. Figure 2 shows an example 
of convergence process comparison between the three algorithms in solving the Sphere test function. It can 
be observed that the modified AGSA shows a faster and more rapid convergence process compared to the 
other algorithms. The AGSA also managed to reach a relatively lower fitness value at the end 
of the iterations. 


Table 3. Comparison on the Average Values of the Returned Solutions 
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AGSA GSA GA 
Sphere 6.34E-06 3.23E-03 1.79E-02 
Rastrigin 9.11E-07 1.27E-04 1.04E+00 
Ackley 7.65E-06 5.52E-03 1.88E+00 
Rosenbrock 5.01E-07 7.AQE-04 3.94E-02 
Booth 5.90E-07 5.13E-05 9.81E-02 
preg Sphere 





Iteration 











Figure 2. Convergence process samples comparison in solving Sphere test problem 


The convergence performance and efficiency can vary in solving test functions with single and 
multiple optima points. To examine the performance of the algorithms in solving test problems with multiple 
optima points and local optima traps, some convergence process in solving the Rastrigin problem are 
sampled and compared in Figure 3. 


Neues Rastrigin 


Iteration 

















AGSA — — —GSA GA 


Figure 3. Convergence process samples comparison in solving test problem with multiple 
local optima traps 


Note that the Objective Value axis for both Figure 2 and 3 are in logarithmic scales. It can be 
observed from both figures that the AGSA shows rapid objective value improvements at the beginning stages 
of the convergence processes. The larger search steps enabled the algorithm to search in relatively quicker 
speed. It can also be observed from the graphs that the AGSA found relatively lower objective values, 
which indicates that it outperformed other algorithms in finding solutions with relatively higher accuracies. 
The adaptive search steps enabled AGSA to further scrutinized the search for better solutions in the 
proximity of a pre-found solution. This gives a boost in solving the speed and accuracy problems in a 
conventional GSA. 


4. CONCLUSION 

In this research, an Adaptive Gravitational Search Algorithm (AGSA) is proposed. The AGSA 
incorporate an adaptive search step local search mechanism into a conventional GSA. This modification 
enhanced the algorithm with a more powerful exploitation ability, which in turn grants solutions with higher 
accuracies. The proposed AGSA is tested in a test suit with several well-established optimization test 
functions, including the Rastrigin function, Ackley function, Sphere function, Booth function and 
Rosenbrock function. The results show that the proposed AGSA out-performed other algorithms in the 
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benchmarking and comparison. It can thus be concluded that the proposed AGSA performs well in solving 
local and global optimization problems. With some minor adjustment, the implementation of AGSA can be 
considered to solve actual engineering optimization problems in time to come. 
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